Estimation of a K − Monotone Density , Part 1 : Characterizations , Consistency , and Minimax Lower
نویسندگان
چکیده
Shape constrained densities are encountered in many nonparametric estimation problems. The classes of monotone or convex (and monotone) densities can be viewed as special cases of the classes of k−monotone densities. A density g is said to be k−monotone if (−1)g is nonnegative, nonincreasing and convex for l = 0, . . . , k−2 if k ≥ 2, and g is simply nonincreasing if k = 1. These classes of shaped constrained densities bridge the gap between the classes of monotone (1-monotone) and convex decreasing (2-monotone) densities for which asymptotic results are known, and the class of completely monotone (∞−monotone) densities. It is well-known that a density is completely monotone if and only if it is a scale mixture of exponential densities (Bernstein’s theorem). Thus one motivation for studying the problem of estimation of a k−monotone density is to try to gain insight into the problem of estimating a completely monotone density. In this series of four papers we consider both (nonparametric) Maximum Likelihood estimators and Least Squares estimators of a k−monotone estimator. In this first part (part 1), we prove existence of the estimators and give characterizations. We also establish consistency properties, and show that the estimators are splines of order k (degree k−1) with simple knots. We further provide asymptotic minimax risk lower bounds for estimating a k−monotone density g0(x0) ∗Research supported in part by National Science Foundation grant DMS-0203320 †Research supported in part by National Science Foundation grant DMS-0203320, NIAID grant 2R01 AI291968-04, and an NWO Grant to the Vrije Universiteit, Amsterdam ‡Corresponding author AMS 2000 subject classifications: Primary 62G05, 60G99; secondary 60G15, 62E20
منابع مشابه
Estimation of a k-monotone density: characterizations, consistency and minimax lower bounds.
The classes of monotone or convex (and necessarily monotone) densities on ℝ(+) can be viewed as special cases of the classes of k-monotone densities on ℝ(+). These classes bridge the gap between the classes of monotone (1-monotone) and convex decreasing (2-monotone) densities for which asymptotic results are known, and the class of completely monotone (∞-monotone) densities on ℝ(+). In this pap...
متن کاملConsistency of the Maximum Product of Spacings Method and Estimation of a Unimodal Distribution
The first part of this paper gives some general consistency theorems for the maximum product of spacings (MPS) method, an estimation method related to maximum likelihood. The second part deals with nonparametric estimation of a concave (convex) distribution and more generally a unimodal distribution, without smoothness assumptions on the densities. The MPS estimator for a distribution function ...
متن کاملA Two Stage k-Monotone B-Spline Regression Estimator: Uniform Lipschitz Property and Optimal Convergence Rate
This paper considers k-monotone estimation and the related asymptotic performance analysis over a suitable Hölder class for general k. A novel two stage k-monotone B-spline estimator is proposed: in the first stage, an unconstrained estimator with optimal asymptotic performance is considered; in the second stage, a k-monotone B-spline estimator is constructed by projecting the unconstrained est...
متن کاملOn the Minimax Optimality of Block Thresholded Wavelets Estimators for ?-Mixing Process
We propose a wavelet based regression function estimator for the estimation of the regression function for a sequence of ?-missing random variables with a common one-dimensional probability density function. Some asymptotic properties of the proposed estimator based on block thresholding are investigated. It is found that the estimators achieve optimal minimax convergence rates over large class...
متن کاملMinimax Density Estimation for Growing Dimension
This paper presents minimax rates for density estimation when the data dimension d is allowed to grow with the number of observations n rather than remaining fixed as in previous analyses. We prove a non-asymptotic lower bound which gives the worst-case rate over standard classes of smooth densities, and we show that kernel density estimators achieve this rate. We also give oracle choices for t...
متن کامل